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Abstract 

Power law distributions have been repeatedly observed in a wide variety of socioeco- 
nomic, biological and technological areas. In many of the observations, e.g., city popula- 
tions and sizes of living organisms, the objects of interest evolve due to the replication of 
their many independent components, e.g., births-deaths of individuals and replications of 
cells. Furthermore, the rates of the replication are often controlled by exogenous parame- 
ters causing periods of expansion and contraction, e.g., baby booms and busts, economic 
booms and recessions, etc. In addition, the sizes of these objects often have reflective 
lower boundaries, e.g., cities do not fall bellow a certain size, low income individuals are 
subsidized by the government, companies are protected by bankruptcy laws, etc. 

Hence, it is natural to propose reflected modulated branching processes as generic mod- 
els for many of the preceding observations. Indeed, our main results show that the proposed 
mathematical models result in power law distributions under quite general polynomial 
Gartner-Ellis conditions, the generality of which could explain the ubiquitous nature of 
power law distributions. In addition, on a logarithmic scale, we establish an asymptotic 
equivalence between the reflected branching processes and the corresponding multiplica- 
tive ones. The latter, as recognized by Goldie (1991) 32J, is known to be dual to queue- 
ing/additive processes. We emphasize this duality further in the generality of stationary 
and ergodic processes. 
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1 Introduction 



Power law distributions are found in a wide range of domains, ranging from socioeconomic 
to biological and technological areas. Specifically, these types of distributions describe the 
city populations, species-area relationships, sizes of living organisms, values of companies, 
distributions of wealth, and more recently, sizes of documents on the Web, visitor access 
patterns on Web sites, etc. Hence, one would expect that there exist universal mathematical 
laws that explain this ubiquitous nature of power law distributions. To this end, we propose 
a class of models, termed modulated branching processes with reflective lower barriers that, 
under quite general polynomial Gartner-Ellis conditions, result in power law distributions. 

Empirical observations of power laws have a long history, starting from the discovery by 
Pareto [60] in 1897 that a plot of the logarithm of the number of incomes above a level against 
the logarithm of that level yields points close to a straight line, which is essentially equivalent 
to saying that the income distribution follows a power law. Hence, power law distributions 
are often called Pareto distributions; for more recent study on income distributions see |161 
[55 | I21 j. [64 | 165]. In a different context, early work by Arrhenius [4] in 1921 conjectured a power 
law relationship between the number of species and the census area, which was followed by 
Preston's prediction in [63] that the slope on the log/log species-area plot has a canonical value 
equal to 0.262; for additional information and measurements on species-area relationships see 
|18|, [62"1 146] . Interestingly, there also exists a power law relationship between the rank of the 
cities and the population of the corresponding cities. This was proposed by Auerbach [8] in 
1913 and later studied by Zipf [73] in 1949, after whom power law is also known as Zipf's law. 
Ever since, much attention on both empirical examinations and explanations of the city size 
distributions have been drawn [731 133 US ES EH [2]. Similar observations have been made 
for firm sizes [3j, language family sizes [72], and even the gene family and protein statistics 
[36\ [69| [54"1 [T3] . It is maybe even more surprising that many features of the Internet are 
governed by power laws, including the distribution of pages per Web site [34], the page request 
distribution [201 02], the file size distribution [251 HQ], Ethernet LAN traffic 09], World Wide 
Web traffic [19] , the number of visitors per Web site [35l CQ , the distribution of scenes in MPEG 
video streams [39] and the distribution of the indegrees and outdegrees in the Web graph as 
well as the physical network connectivity graph [26\ [9l [4"8"1 156] . In socio-economic areas, in 
addition to income distributions, the fluctuations in stock prices have also been observed to be 
characterized by power laws |29[ [50] . This paragraph only exemplifies various observations of 
power laws; for a more complete survey see [57] . 

Hence, these repeated empirical observations of power laws over a period of more than a 
hundred years strongly suggest that there exist general mathematical laws that govern these 
phenomena. In this regard, after carefully examining the situations that result in power laws, 
we discover that most of them are characterized by the following three features. First, in the 
vast majority of these observations, e.g., city populations and sizes of living organisms, the 
objects of interest evolve due to the replication of their many independent components, e.g., 
birth-deaths of individuals and replications of cells. Secondly, the rate of replication of the 
many components is often controlled by exogenous parameters causing periods of baby booms 
and busts, economic growths and recessions, etc. Thirdly, the sizes of these objects often 
have lower boundaries, e.g., cities do not fall bellow a certain size, low income individuals are 
subsidized by the government, companies are protected by bankruptcy laws, etc. 

In order to capture the preceding features, it is natural to propose modulated branching 
processes (MBP) with reflective or absorbing barriers as generic models for many of the obser- 
vations of power laws. Indeed, one of our main results, presented in Theorem [31 shows that 
MBPs with reflective barriers almost invariably produce power law distributions under quite 



2 



general polynomial Gartner-Ellis conditions. The generality of our results could explain the 
ubiquitous nature of power law distributions. Furthermore, an informal interpretation of our 
main results, stated in Theorems [3] and 2] of Section [3l suggests that alternating periods of 
expansions and contractions, e.g., economic booms and recessions, are primarily responsible 
for the appearance of power law distributions. Actually, Theorem H] shows that the distribu- 
tion of the reflected MBP is exponentially bounded if the process always contracts. From a 
mathematical perspective, we develop a novel sample path technique for analyzing reflected 
modulated branching processes since these objects appear new and the traditional methods for 
investigating branching processes [7j do not directly apply; a preliminary version of this work 
has appeared in the extended abstract in [32]. 

Formal description of our reflected modulated branching process (RMBP) model is given 
in Section [2j In the singular case when the number of individuals born in each state of 
the modulating process is constant, our model reduces to a reflected multiplicative process. 
A rigorous connection (duality) between the reflected multiplicative processes (RMPs) and 
queueing theory was established in Section 5 of Goldie (1991) [32]; this duality was repeatedly 
observed and used later in, e.g., |71|. 133]. In Subsection 12.11 we further emphasize this duality 
in the context of stationary and ergodic processes. We would like to point out that this duality 
makes a vast literature on queueing theory directly applicable to the analysis of RMPs. As 
a direct consequence of this connection, in Subsection 12.11 we translate several well known 
queueing results to the context of RMPs. Informally, these results show that the role which 
exponential distributions play in queueing theory, and in additive reflected random walks 
in general, is represented by power low distributions in the framework of RMPs/RMBPs. 
Furthermore, this relationship appears to reduce the debate on the relative importance of 
power law versus exponential distributions/models to the analogous question of the prevalence 
of proportional growth versus additive phenomena. Interestingly, the power law distribution 
satisfies the memoryless property in the multiplicative world, playing an equivalent role to the 
memoryless exponential distribution in the additive world. Indeed, if P[M > x] = x~ a ,a > 
0, x > 1, then, for x,y>l, we obtain P[M > xy\M > x] = P[M > y}. 

Furthermore, this duality immediately implies and generalizes many of the prior results 
in the area of RMPs and power laws, e.g., see [511 [52j [501 EI]- Furthermore, we would like 
to point out that the reflective nature of the barrier, assumed in the previous studies, is not 
essential for producing power law distributions. Indeed, one only needs a positive lower barrier, 
e.g., porous, absorbing or reflective one, which is a natural condition since no physical object 
or socioeconomic one can approach zero arbitrarily close without repelling from it or simply 
disappearing. In many areas, objects of interest may not have a strictly reflecting barrier, but 
rather a porous one, e.g., cities may degenerate, bankruptcy protection may sometimes fail and 
a company can be liquidated. In these cases, the power law effect follows from the well-known 
queueing results on cycle maximum that we briefly stated in Subsection 12.21 This observation 
presents a rigorous explanation for the previous study in [TT] that argued heuristically how 
multiplicative processes with absorbing barriers can result in power laws. 

Here, we would like to point out that the stochastic difference equation (M n+ \ = J n M n + 
Q n ) with random coefficients is closely related to RMPs and is known to produce power law 
distributions. It appears that the first rigorous study of this process was done by Kesten in 1973 
[47]; for later investigations of this model see |22}I23| and the references therein. In addition, we 
refer the reader to equations (1.1) — (1-6) on p. 126 of [32] for other related stochastic recursions 
of multiplicative nature that produce power laws. 

Next, it is easy to see that RMBPs reduce to RMPs in the special case when constant 
number of individuals are born in each state of the modulating process. However, our main 
result, Theorem [3l reveals a general asymptotic equivalence between the power law exponent 
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of a RMBP and the corresponding RMP. In other words, Theorem [3] discovers the asymptotic 
insensitivity of the power law exponent on the conditional distributions of the reflected branch- 
ing process beyond their conditional mean values. Furthermore, for the special case when the 
modulating process is i.i.d., we sharpen the result on the logarithmic asymptotics of Theorem 
[3] to the exact one in Theorem [7] by using the implicit renewal theory of Goldie 1991 |32j. 

In some domains, e.g., the growth of living organisms, the objects always grow (basically 
never shrink) up until a certain random time. Huberman and Adamic [3l] also propose this 
model as an explanation of the growth dynamics of the World Wide Web by arguing that the 
observation time is an exponential random variable. This notion has been revisited in [64J and 
generalized to a larger family of random processes observed at an exponential random time |66j. 
In this regard, in Subsection l5.1.2l we study randomly stopped modulated branching processes 
and show, under more general conditions than the preceding studies, that the resulting variables 
follow power laws. 

In regard to the previously mentioned situations with absorbing barriers, we discuss MBP 
with an absorbing barrier in Subsection 15.21 and argue that it leads to power law distributions 
as well. We conjecture that these types of models can be natural candidates for describing the 
bursts of requests at popular Internet Web sites, often referred to as hotspots. 

Based on our new model, we discuss two related phenomena: truncated power laws and 
double Pareto distributions. We argue that one can obtain a truncated power law distribution 
by adding an upper barrier to RMBP, similarly as the truncated geometric distributions appear 
in queueing theory, e.g., finite buffer M/M/l queue. Furthermore, by the duality of RMBP 
and queueing theory, we give two new natural explanations of the origins of double Pareto 
distributions that have been observed in practice. In the queueing context, it has been shown 
that the tail of the queue length distribution exhibits different decay rates in the heavy-traffic 
and large deviation regime, respectively [59]; similar behavior of the queue length distribution 
was attributed to the multiple time scale arrivals in [38]. We claim that the preceding two 
mechanisms, when translated to the proportional growth context, provide natural explanations 
of the double Pareto distributions. 

Finally, we would like to mention that there might be other non multiplicative mecha- 
nisms that result in power law distributions, e.g., the randomly typing model used to explain 
the power law distribution of frequencies of words in natural languages [57] and the highly 
optimized tolerance studied in [15] . Very recently, the new power law phenomenon in the 
situations where jobs have to restart from the beginning after a failure was discovered in |27] 
and further studied in |701 [6]; equivalently in the communication context, the retransmission 
based protocols in data networks were shown to almost invariably lead to power laws and, in 
general, heavy tails in [41| , I44| , |4"3" 1 145j. For a recent survey on various mechanisms that result 
in power laws see [57] , 

The rest of the paper is organized as follows. After introducing the modulated branching 
processes in Section [21 we study the duality between the queueing theory and the multiplicative 
processes with reflected barriers in Subsection 12.11 and absorbing barriers in Subsection 12.21 
respectively. Then, we present our main results in Section [3] on the logarithmic asymptotics of 
the stationary distribution of the reflected modulated branching process and the corresponding 
multiplicative one, which is followed by the study of the exact asymptotics under the more 
restrictive conditions in Section [4[ As further extensions, we discuss three related models in 
Section i.e., randomly stopped processes in Subsection 15.11 modulated branching processes 
with absorbing barriers in Subsection 15.21 and truncated power laws in Subsection 15.31 In the 
end, Section [6] presents the majority of the technical proofs that have been deferred from the 
preceding sections for increased readability. 
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2 Reflected Modulated Branching Processes 

In this section we formally describe our model. Let {J n } n >-oo be a stationary and ergodic 
modulating process that takes values in positive integers. Define a family of independent, non- 
negative, integer-valued random variables {B n (j)}, — oo < i,j,n < oo, which are independent 
of the modulating process { J n }. In addition, for fixed j, variables {B (j) , B' n (j)} are identically 
distributed with /x(j) = E[B(j)] < oo. 

Definition 1. A Modulated Branching Process (MBP) {^ n }^=o * s recursively defined by 

Zn 

Zn+l — y^ B n(.Jn), (1) 
i=l 

where the initial value Zq is a positive integer. For increased clarity, we may explicitly write 
{Z l n } when Zq = I. 

Definition 2. For any I £ N and an integer valued Aq, a Reflected Modulated Branching 
Process (RMBP) {A n }^ is recursively defined as 



A n+ i = max ^2B l n (J n ), I 



(2) 



Remark 1. These types of modulated branching processes with a reflecting barrier appear to 
be new and, thus, the traditional methods for the analysis of branching processes [7] do not 
seem to directly apply. 

Remark 2. A more general framework would be to define 

Z n+1 = I S*(J ft (t))di/(t), (3) 
for any real measure v and, similarly, 



o 



A n+1 =maxN BlXJn{t))du{t), I J , (4) 

where / > and B^(J n (t)) is ^-measurable. We refrain from this generalization since it 
introduces additional technical difficulties without much new insight. 

Now, we present the basic limiting results on the convergence to stationarity of Z n and A n . 

Lemma 1. //Elog/i(Jo) < 0, then a.s., we have 

lim Z n = 0. 

n^oo 

Proof. For all n > 1, let W n = Z n jXP n _ x , where H"° = IlLoM' 7 ;)- lt is eas y to check that W n 
is a positive martingale with respect to the filtration T n = a(Ji,Zi,0 < i < n — 1). Hence, 
by the martingale convergence theorem (see Theorem 35.5. of |10j). almost surely (a.s.) as 

n — > oo, 

W n -» W < oo. (5) 
Next, since {J n } is stationary and ergodic, so is {^(J n )}, and therefore, a.s., 

logn°_ 1 n_1 

= — y log//(Ji) — * Elog/i(Jo) < as n — > oo. 

n n z — ' 

Thus, n°_! -> as n — > oo, which, by recalling ([5]) and Z n = Wnll^]^, finishes the proof. □ 
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Next, let Z_ n be the number of individuals at time in an unrestricted branching process 
that starts at time — n with I individuals; when needed for clarity, we will use the notation 
Z l _ n to explicitly indicate the initial state I. 

Lemma 2. Assume E log //(Jo) < 0, then, for any a.s. finite initial condition Aq, A n converges 
in distribution to 

A = max Z_ n . 

n>0 

Proof. First, assume that Ao = / and let Z^ be the number of individuals at time n in an 
unrestricted branching process that starts at time k with I individuals. Then, by stationarity 

of {J n }, we have Z% = Z^-n- Clearly, 



Ai = max ^ ^2b\(Ji),1 ^ = max{ Z^i,Zq }, 



and, by induction and stationarity, it is easy to show 

A n = max( Z- n ,Z_( n _X),--- ,Z_i,Z ), (6) 

where Z- n , ■ ■ ■ ,Zq are defined on the same sequence {B l k ( Jk)}i>i, —n <k<0. Hence, by 
monotonicity, we obtain 

P[A n > x] — >• P[A > x] as n — >• oo. 

Now, if A^° is a process defined on the same sequence {B n (J n )} with the initial condition 
Aq>1, then, it is easy to see that 

A^° > A n > I, for all n, 

implying 

P[A^° > x] > P[A n > x]. (7) 

Next, if we define the stopping time r to be the first time when A^° hits the boundary /, then 
the preceding monotonicity implies that A n = A^° for all n > r. Using this observation, we 
obtain 

P[A^° >x} = P[A^° > x, t > n] + P[A^° >x,r<n] 
= P[A^° > x, t > n] + P[A n >x,t <n] 

< P[r > n] +P[A n > x}. (8) 
Next, by Lemma [H r is a.s. finite and, thus, by (J7]) and (jHJ), we conclude 

lim P[A n > x] = lim P[A^° > x] = P[A > x]. 

n— >oo n^oo 

□ 



2.1 Reflected Multiplicative Processes and Queueing Duality 

Note that in the special case B l n (J n ) = J n , reflected modulated branching processes reduce to 
reflected multiplicative processes with J n being integer valued. In general, using the definition 
in ([3]), J n can be relaxed to take any positive real values. Hence, in this subsection we assume 
that { J n } n >o is a positive, real valued process. 
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Definition 3. For I > and Mq < oo, define a Reflected Multiplicative Process (RMP) as 

M n+1 = max( M n -J n ,l), n > 0. (9) 

The preceding RMP model was studied by Goldie in 1991 [32]; for later considerations of 
this model see [71] E2J EH ESI E31 E5] • Goldie [32] also shows a direct connection (duality) 
between RMP and queuing theory in Section 5 of [32J for the case when {J n } is an i.i.d. 
sequence. Here, we study this duality further in the generality of stationary and ergodic 
processes. 

Without loss of generality we can assume 1 = 1, since we can always divide ([9]) by / and 
define M\ = M n /l. Now, let X n = log J n and Q n = logM n with the standard conventions 
logO = — oo and e~°° = 0. Then, for I = 1, equation ([9]) is equivalent to 

Q n+ i = max(Q n + X n , 0), (10) 

which is the workload (waiting-time) recursion in a single server (FIFO) queue. 

Lemma 3. //Elog J n < 0, then M n converges in distribution to an a.s. finite random variable 
M that satisfies 

M = su P n„, (ii) 

n>0 

where n = 1, U n = Y\il- n J ^ n ^ 1 - 

Proof. By the classical result of Loynes [53], Q n , defined by (llOp . converges in distribution to 
an a.s. finite stationary limit Q if EX n = Elog J n < and, furthermore, 

Q = SUpS n , 
ra>0 

where So = and S n = J27=-n-^i- This implies the convergence in distribution of M n to 

M = e sup ">° 5 " = supe 5 ' 1 = supll„. 

n>0 n>0 

□ 

The following theorem is a direct corollary of Theorem 1 in [31]; see also Theorem 3.8 in 
[17j and, for a more recent presentation, we refer the reader to |30| . 

Theorem 1. Let {J n } n >i be a stationary and ergodic sequence of positive random variables. 
If there exists a function ^ and positive constants a* and e* such that 

1) n _1 logE[(n n )°] — > *(a) as n — > oo for \ a - a* |< e* , 

2) \I/ is finite and differ entiable in a neighborhood of a* with it (a*) = 0, > 0, and 

3) E [(II n ) a * +e ] < oo, for n > 1 and some e > 0, 
th&Tt 

lim logP[M>x] = _^ 

x^oo log X 
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Remark 3. We refer to conditions 1) — 3) as the polynomial Gartner-Ellis conditions. Note 
that condition 2) can be relaxed such that ^ is only differentiable at a* and condition 3) can 
be weakened to e = [31] . Since conditions 2) and 3) are used for Theorem [3] in Section [31 we 
keep the current form to provide a unified framework. Also, it is worth noting that the mul- 
tiplicative process IT n without the reflective boundary would essentially follow the lognormal 
distribution, as it was recently observed in [33] (this is similar to the fact that the unrestricted 
additive random walk is approximated well by Normal distribution). However, we would like to 
reemphasize that the lower boundary I is not just a mathematical artifact, but a very natural 
condition since no physical object can approach zero arbitrarily close without either repelling 
(reflecting) from it or vanishing (absorbing); the absorbing boundary will be discussed in the 
following Subsection 12.21 

Here, we illustrate the preceding theorem by the following examples. Assume that {^4 n } 5 {C n } 
are two mutually independent sequences, and let J n = e An ~ Cn . Then the quantity Q n = 
logM n , where M n is defined in ([9]), satisfies 

Qn+l = (Qn + A n - C n ) + . (13) 

The first two examples assume that {^4 n },{C n } are two i.i.d. sequences, the third example 
takes {J n } to be a Markov chain, and in the last example, {J n } is modulated by a Markov 
chain {X n }. 

Example 1. If {A n },{C n } follow exponential distributions, P[C n > x] = e~^ x , ¥[A n > x] = 
e~ Xx and A < /j,, then Q n represents the waiting time in a M/M/l queue. By Theorem 9.1 of 
[5], the stationary waiting time in a M/M/l queue is distributed as 

P[Q > x ] = - e -^ x >, x>0, 
A 1 

which equivalently yields a power law distribution for M, 

F[M > x}= F[Q > logx] = , x > 1 

with power exponent a = \i — A. 

Example 2. If {A n },{C n } are two i.i.d Bernoulli processes with P[A n = 1] = 1 — ¥[A n = 
0] = p, P[C n = 1] = 1 — P[C ra = 0] = q, p < q. Then, the elementary queueing/Markov 
chain theory shows that the stationary distribution of Q n , as defined in (|13p . is geometric 
P[Q > j] = (1 — P)P* ,j > 0, where p = p(l — q)/q(l — p) < 1. Therefore, 

P[M > x] =F[Q > logx] = p L 1 °s a: J, X >1. 

Since logx — 1 < [logxj < logx, it is easy to conclude that 

, \, ; < P[M > X] < j — TTT\ - 
x log(l/p) 1 p X log(l/p) 

Example 3. If {J n } is a Markov chain taking values in a finite set £ and possessing an 
irreducible transition matrix Q = (q(i, - g2 , then the function ^ defined in Theorem [1] can 
be explicitly computed. To this end, define matrix Q a with elements 

Qa(i,j) = q(i,j)j a , i,j e S. 
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By Theorem 3.1.2 of [24], we have as n — > oo, 

n-MogEf^)"] ^log(dev(Q Q )), 

where dev(Q a ) is the Perron-Probenius eigenvalue of matrix Q a . To illustrate this result, we 
take S = {u, d} where u = 1/d > 1, and q(d, u) = q, q(d, d) = 1 — q, q(u, d) = p, q{u, u) = 1 — p 
where p > q. It is easy to compute 



Qc 



(1 — p)u a pd a 

(1 - q)d a 1 ' 



qu 



and, by letting log (dev(<5 Q )) = 0, we obtain 

. loKfl- 



a 



log(l -p) 



log u 



Example 4 (double Pareto). If {J n = J(X n } is modulated by a Markov chain X n , we argue 
that P[M > x] can have different asymptotic decay rates over multiple time scales. This 
phenomenon was investigated in [38] in the queueing context and formulated as Theorem 3 
therein. To visualize this phenomena, we study the following example. Consider a Markov 
process X n of two states (say {1,2}) with transition probabilities p\2 = 1/5000, P21 = 1/10, 
and P[J(1) = 1.2] = 1 - P[J(1) = 0.6] = 0.5, P[J(2) = 1.7] = 1 - P[J(2) = 0.25] = 0.6. The 
corresponding simulation result for 5 x 10 7 trials is presented in Figure [H We observe from 
this figure a double Pareto distribution for M , which provides a new explanation to the origins 
of double Pareto distributions as compared to the one in [67] . 
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Figure 1: Illustration for Example H] of the double Pareto distribution. 



Remark 4. For reasons of simplicity, we have chosen { J n } in all of the preceding examples 
to be Markovian. However, Theorem Q] extends beyond the Markovian framework, e.g., {</«} 
can be a semi-Markov process where the periods of (sojourn) time that the process spends in 
a state are asymptotically exponential but not necessarily memoryless. 
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2.2 Multiplicative Processes with Absorbing Barriers and Cycle Maximum 



As briefly discussed in the introduction, we explained that the reflective nature of the barrier 
is not essential for producing power law distributions. Indeed, one only needs a positive lower 
barrier, e.g., porous, absorbing or reflective one, which is a natural condition since no physical 
objects or socioeconomic ones can approach zero arbitrarily close without repelling from it 
or simply disappearing. To illustrate the situations when the objects can vanish, we name a 
few examples, e.g., cities may degenerate, bankruptcy protection may sometimes fail and a 
company can be liquidated. In these cases, the power law effect follows from the well-known 
queueing result on cycle maximum that is stated in Theorem [2] below. We also discuss in 
Subsection 15.21 a more complicated situation when newly generated objects in the system can 
arrive/appear or leave/disappear. 

Following the notation from Chapter VIII of [5j, for a sequence of positive i.i.d. random 
variables {J, J n } n >i, denote by G + the ladder height distribution of the random walk {S n = 
Yli=x 1°§ Ji}n>i with \\G + \\ = F[S n < for all n > 1], and define the stopping time r = inf{n : 
S n < 0, n > 1} with the corresponding cycle maximum M T = sup{J3™ =1 Jj : 1 < n < r}; here 
we assume, without loss of generality, that the absorbing barrier is equal to 1. 

Theorem 2. If the sequence {log J n }n>i is nonlattice, satisfying K[J a *] = 1, a* > and 
mJ a })'\ a =a* < oo, then 

, . (l- iiG + n)(i-Er e - Q * 5 -i) 

lim P [M T > x]x a = ± " J£ n ; I , - iJ . 

x^oo a * J Q xe a x G + {ax) 

Proof. The result is a direct consequence of Corollary 5.9 on p. 368 of [5]. □ 



3 Main Results 

This section presents our main results in Theorems [3] and [H To avoid technical difficulties, 
we assume (jl = infj fi(j) > 0. With a small abuse of notation, as compared to the preceding 
Subsection 12.11 we redefine here IT n = IX^-nM^i)' n — 1> = I and M = sup n>0 II n . In 
this paper we use the following standard notation. For any two real functions a(t) and b(t), 
we use a(t) = o(b(t)) to denote that limt_ ) . 0O a(t)/b(t) = 0, and a(t) = 0(b(t)) to denote that 
linij^oo a(t)/b(t) < oo; when needed for increased clarity, we may explicitly write a(t) = o(b(t)) 
as t — ► oo. 

Theorem 3. Assume that the process {II n } satisfies the polynomial Gartner- Ellis conditions 
(conditions 1) — 3) of Theorem\T$, and sup^ E Je^wJ-wOI] < oo for some 9 > 0, then, 

Hm logF[A>x] = Hm logF[M^] = 

x-+oc log X x—>co log X 

Remark 5. Note that conditions 1) and 2) of Theorem [1] imply that there exists j such that 
fj,(j) > 1, since otherwise we have sup a ^I / (a) < 0, which would contradict ^f(a*) = and 
^'(a*) > in condition 2). The following theorem covers the opposite situation when the 
previous condition is not satisfied, i.e., sup,- < 1. 

Theorem 4. If supj < 1 and supj E [e^wJ-WJl] < qq f or some > 0, then, 

Hm l08 f A>1 ' = -co. (15) 

x^co log X 
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Remark 6. Informally speaking, these two theorems show that the alternating periods of 
contractions and expansions, e.g., economic booms and recessions, are primarily responsible for 
the appearance of power law distributions; in other words, if there are no periods of expansions, 
i.e., the condition sup^ < 1 of Theorem|4]is satisfied, then A has a tail that is lighter than 
any power law distribution. Furthermore, the first equality in (|14[) of Theorem [3] reveals a 
general asymptotic equivalence between the reflected modulated branching process and the 
corresponding reflected multiplicative process, showing that the power law exponent a* is 
insensitive to the higher order distributional properties of B{j) beyond the conditional mean 

Remark 7. A careful examination of the proofs reveals that the existence of a uniform 
upper bound of the exponential moments for \B(j) — fj>(j)\ could possibly be relaxed to 
supjE[\B(j) — /i(j)\ a ] < oo for a > a*. However, such an extension would considerably 
complicate the proofs. Furthermore, in most practical applications the distributions of {B(j)} 
are typically very concentrated. For the preceding reasons, we do not consider such extensions. 

We present the proofs of Theorems [3] and H] in Subsection 16.11 



4 Exact Asymptotics 

This section presents the exact asymptotic approximations of the RMPs and RMBPs in the 
following two subsections, respectively. 



4.1 Exact Asymptotics of RMPs and the double Pareto phenomenon 

The following two theorems essentially provide a new general explanation of the measured 
double Pareto phenomenon (e.g., see [Ml[67]) since they rely on two universal statistical laws: 
the first one being based on the large deviation theory and the latter being implied by the 
central limit theorem. 

The theorems are direct translations from the corresponding queueing theory results. The- 
orem [5] is based on the large deviation result that studies the situation when M is large, and 
Theorem [6] is derived from the heavy traffic approximation of a GI/GI/1 queue where we 
study the limiting behavior of a sequence of multiplicative processes with the multiplicative 
drift tending to one. These two theorems are basically corollaries of Theorem 5.2 in Chapter 
XIII and Theorem 7.1 in Chapter X of [5J, respectively. 

For a sequence of positive i.i.d. random variables {J, J n }n>i, define G + to be the lad- 
der height distribution of the random walk {S n = Y17=i 1°§ Ji}n>i with ||G + || = F[S n < 
for all n > 1]. 

Theorem 5. // the sequence {log J n }n>i is nonlattice, satisfying E[J Q ] = 1, a* > 0, and 
(E[J a })'\ a =a* < oo, then 



lim P[M > x]x c 



\G A 



a* J °° xe a * x G + {dx)' 

Proof. The result is a direct consequence of Theorem 5.3 in Chapter XIII of [5]. □ 

Remark 8. If S n is lattice valued, see Remark 5.4 of Chapter XIII on p. 366 of [5]. 

Now, we study the limiting behavior of a sequence of multiplicative processes indexed by 
an integer k where j( k \ Sn and are properly defined for all k > 1. 
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Theorem 6. If { j( fc ) , J ( n ] } are positive and i.i.d. for each fixed k with = E [log JW] , 

I J n>l 

o~\ = Var [log J^] , the random walks { Sn = Efc=i l°g j\ } satisfy < 0, lim^oo = 

I J n>l 

0; llnifc^oo cr fc > 0; an d (log J^) is uniformly integrable for all k, then, for y > 1, 

' (M^)' mk ' ai > y 



lim ] 

k— >oo 



1/2/ 



Proof. From Theorem 7.1 in Chapter X on p. 287 of [5], we have, for z > 0, 



lim I 

fc— >oo 



-^|logM( fc )>z 



which, by letting z = logy, finishes the proof of Theorem EJ □ 
4.2 Exact Asymptotics of Reflected Branching Processes 

In this subsection, assuming that { J, J n }n>i ar e i.i.d. and {log/i(J)} is nonlattice, we will 
give an exact asymptotics for RMBPs using the implicit renewal theorem of Goldie (1991); 
see Theorem 2.3 and Corollary 2.4 in [32]. To this end, let {B(j), B l (j)}ij be independent 

random variables that are independent of { J, J n } and satisfy B % (j) — B(j). 

Theorem 7. If sup^- E [ e e \ B ^-^\] < oo for some 6 > 0, E[ / u(J) Q *] = I, a* > and 
E[/i(J) a *+ 5 ] < oo for some 5 > 0, then, 



E 

lim PfA > x]x a * 



(AT -(MW 



x— >oo 



a*E[/j(J) Q * log //(J)] ' 
where A* = max I X]^=i I ) anc ^ A is independent of J and {B l (j)} 



(16) 



Remark 9. The preceding result is implicit because the constant on the right hand side of 
equation (|16p involves the value of A, which is what we are trying to compute. In principle, 
to derive the explicit exact asymptotics for RMBPs is a difficult problem since the asymptotic 
constant depends on the behavior around the boundary I. However, in the scaling region where 
the boundary I grows as well, albeit slowly, one can derive an explicit asymptotic characteri- 
zation. 

In the following, similarly as in Theorem[5l we let G+ be the ladder height distribution of the 
nonlattice random walk {S n = YL?=i l g^(^i)}n>i with ||G+|| = ¥[S n < for all n > 1] < 1. 
Theorem 8. // sup fc E [ e "|B(*0-M*OI] < ^ f or some q > , ^ 4 infj > 0, E[^(J) a *] = 1 
for some a* > with (E[J a ]) \ a=a * < oo, then, for any 7 > 0, 

lx II ^ _l„a!* 1 ~~ 11^+11 



lim ¥[A lx /l x > x]x 



i x > (lozxf+i x a* J °° xe a * x G+(dx) 

x — ► 00 

The proofs of Theorems [7] and [8] are presented in Subsection 16.21 Here, we illustrate the exact 
asymptotics of the reflected branching process with the following simulation example. 

Example 5. Assume that {J n }n>l is a Bernoulli process with P[J n = 1] = 0.4 = 1 — P[J n = 0] 
and the i.i.d. random variables {B n (l)}i>i, {i?^(0)}j>i follow Poisson distributions with means 
1.5 and 0.6, respectively. The simulation results of 10 samples, for I = 1,5,13,21, are drawn 
in Figure l4~2l From the figure we can clearly see that P[A'/Z > x] approaches the limiting value 
very quickly, i.e., for I = 13 and I = 21, the plots of P[A'/Z > x] are basically indistinguishable. 
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Exact Asymptotics of Reflected Branching Processes 




10° io 1 10 2 10 3 10* 

X 



Figure 2: Simulation of F[A l /l > x] versus x parameterized by I. 

5 Discussion of Related Models 

Based on the study of reflected modulated branching processes, we address three related mod- 
els: randomly stopped processes, modulated branching processes with absorbing barriers and 
truncated power laws. 

5.1 Randomly Stopped Processes 

In this subsection we discuss randomly stopped multiplicative and branching processes, respec- 
tively. 

5.1.1 Randomly Stopped Multiplicative Processes 

The following two theorems show that randomly stopped multiplicative processes and reflected 
multiplicative processes are intimately related and, to a certain extent, basically equivalent 
under more restrictive conditions. By following the approach of Chapter VIII of [5], we study 
the ladder heights of a multiplicative process. For any RMP with i.i.d positive multiplicative 
increments, the random variable M, as defined in Lemma O can be represented in terms of 
the ladder heights. To this end, define 11° = n^=o ^ anc ^ the ladder height process {i/j}j>i of 
{S n = YTi=i log J i)n>i with ||G+|| = F[S n < for all n > 1} < 1 and Hf = e H \ 

Theorem 9. Suppose that {J, J n }n>i is a positive i.i.d. sequence with E[log<7] < 0, then, 

N 

M = l[Hf, (17) 

i=i 

where N is independent of {Hf}i>i and follows a geometric distribution ¥[N > n] = ||G+|| n . 
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Proof. Based on the well-known Pollaczek-Khinchin representation (see Chapter VIII of [5]) 



N 



logM^^^, 



where N is independent of {Hi} with ¥[N > n] = ||G+|| n , it immediately follows that 

N 



P[M > x] = P 



> X 



i=l 



□ 



Conversely, we can prove that if the observation time has exponential tail, the stopped 
process has a power law tail under quite general conditions. Note that here we do not require 
{ J n } to be an i.i.d. sequence. 

Theorem 10. Let N be an integer random variable independent of {J n } with 

logPfiV > x] 



lim 

x— >oo 



-A < 0. 



X 



For a positive ergodic and stationary process {J n }n>o> */ n 1 log IE [(ll^)"] — ► ^(a) < oo as 
n — > oo in a neighborhood of a* > 0, ^(a) is differentiable at a* with \l/(a*) = A, \&'(a*) > 



and E 



(11°)" < oo for n > 1, then, 



lim 

x— >oo 



io g p[n^ > 

logx 



-a 



(18) 



The proof of Theorem [10] is presented in Subsection [HT 



Remark 10. This theorem generalizes the previous results from [341 [641 66j where only i.i.d. 
multiplicative increments are considered. 

Actually the following theorem shows that randomly stopped multiplicative processes and 
reflected multiplicative processes are basically equivalent under more restrictive conditions. 
This equivalence is established using classical results on M/GI/1 queue. In this regard, we 
assume that { J n }n>i is an i.i.d. process, 11° is the corresponding multiplicative process, N is 
a geometric random variable that is independent of 11° with P[N > n] = p n ,0 < p < 1, and 
G(t),t > is a complementary cumulative distribution function. 

Theorem 11. If a randomly stopped multiplicative process n°y satisfies 



[log Ji < x] 



G{y)dy, x>0 



for some G(-), then, we can always construct a stationary RMP such that 11^ = M. Fur- 
thermore, if in addition e a y G{y)dy = p~ x / °° G(y)dy, / °° ye a v G(y)dy < oo for a* > 0, 
then, 



lim P [M > x] x a * = lim P \U° N > x] x 
The proof of Theorem [TT] is presented in Subsection 



a*p r °° ye a *yG{y)dy 



14 



5.1.2 Randomly Stopped Branching Processes 

In the following theorem, we extend Theorem 1101 of the preceding subsection to the context of 
randomly stopped branching processes. Define 11° = Yli=o ^(^i) • 

Theorem 12. Suppose that N is independent of B^(j) > 1 for all n,i,j. Then, under the 
same conditions as in Theorem\Mwith E [(11°)°] < oo forn > 1 and ^(a) being differentiable 
in a neighborhood of a* > 0, we obtain, for {Z n } n >o defined in (CP with a bounded initial value 
Zq < Zq < co, 

logF[Z N >x] log¥[U%>x] 
lim = lim = —a . 

x^co log X x^oo log X 

The proof of this theorem is based on similar arguments as in the proof of Theorem [3l and 
we defer it to Subsection 16,31 

5.2 Branching Processes with Absorbing Barriers 

For many dynamic processes, e.g., city sizes, quite often when the sizes of the objects fall 
below a threshold, the whole object disappears, e.g., urban decay. Therefore, it is natural to 
study branching processes with absorbing barriers. As already discussed in Subsection 12.21 
we know that a single object with an absorbing barrier can result in power law distributions 
based on the duality with the queueing cycle maximum. In this context, we can also study a 
more complicated situation where the newly generated objects can join the system and evolve 
together. This naturally models the arrivals to popular Web sites (hotspots), since information 
(news) is distributed according to a branching process, e.g., user A passes the information to B 
and C; further B may inform D, etc. Empirical examination shows that Web requests follow 
power law distributions, e.g., see [35| ITj. 

For a lower barrier I > and the modulated branching process {Z^} n >i with Zq = I 
specified in Definition [IJ define stopping time P = inf{n > : Z l n < I}, where the modulating 
process {J, J n } is a sequence of i.i.d. random variables. This branching process, denoted by 
Zp, vanishes completely after P; it is easy to prove that E[P] < oo when E[log/^(Jo)] < 0. 

Let the arrivals {^4 n }n>-oo be a sequence of i.i.d. Poisson random variables with EL4 n ] = 
q > that is independent of other random variables. At time n, A n objects are generated 
and join the system, each evolving according to an i.i.d. copy of the modulated branching 
process Zp. Suppose that the system has reached its stationarity with N n objects being in 
the system at time n, and then, by Little's Law, E[iV n ] = gE[P]. Furthermore, assume that 
object j observed at time n = 0, if any, is generated at time (—PI) with a size Z l _ pr , where 

the random variables {PJ} are i-i-d. and follow the equilibrium distribution of P. Then, the 
total size of all objects Z s observed at time n = in stationarity can be represented as 

N 

Z s = '^2 Zlpr . 

i=i 

Next, we show that Z s follows a power law. The proof of the following theorem is essentially 
a corollary of Theorem [3l 

Theorem 13. Under the conditions described in this subsection, if{fi(J n )} satisfies infj fj,(j) > 
0, E[log/x(J)J < 0, E[n(J) a *] = 1 for some a* > 0, E[//( J) a * +S ] < co for some 5 > 0, and 
supj-E [e £, l- B( j)~^ ( j)l] < oo for some 9 > 0, then, 

.. logP[Z s >x] 

hm - 1 = —a . 

x-^co log X 

The proof of this theorem is presented in Subsection 16.41 
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5.3 Truncated Power Laws 



Truncated power laws have been observed empirically in many practical situations where the 
studied objects have natural upper boundaries. Here, we want to point out that by using 
the duality between the modulated branching processes and the queueing theory, one easily 
obtains truncated power laws when adding both a lower and an upper barrier to the modulated 
branching process. To illustrate this point, recall that M/M/l/b queue with a finite buffer b 
results in a truncated geometric distribution for the number of customers in the queue, and by 
the duality, it essentially follows that in a proportional growth world with both a lower and 
an upper barrier, truncated power laws can naturally arise, playing a similar role as truncated 
exponential/geometric distributions do in an additive world. Prior related work on this subject 
can be found in [7T] . 



6 Proofs 

6.1 Proofs of Theorems [3] and [4] 

The proof of Theorem [3l composed of the upper bound and the lower bound, and the proof of 
Theorem |4] are presented in the following three subsections, respectively. 



6.1.1 Proof of Theorem [33 Upper Bound 

Since the proof is based on the change (increase) of boundary I, we denote this dependence 
explicitly as A' = A. According to Lemma [H the initial value of {A n } has no impact on A 
and, therefore, in this subsection we simply assume that Aq = I. Before stating the proof of 
the upper bound, we establish preliminary Lemmas [U El [6] and El 

The first lemma shows that, most likely, the supremum of Z n occurs for an index n < x. 

Lemma 4. For any (3 > 0, the branching process Z l n defined in ([7]) satisfies 



oo 

£«■[■ 



Z n ^> x 



O I — a 1 as x — > oo. 



n>x 

Proof. Similarly as in the proof of Lemma[H note that for n°_ 1 = ni^o 1 M^Oi the stochastic 
process W n = Z l n /~B^_ 1: n > 1 is a martingale with respect to the filtration T n = cr( Jj, Zj, < 
i < n — 1) that satisfies E[Wi] = 1. Therefore, by recalling Il n = Y\i = _ n fJ>{Ji) , we obtain, for 
any e > 0, 

F[Z l n >x]= nWnK-i >A = n(W n e- £n )«-iZ £n ) > x] 

< F[W n e- £n > 1] + P[n n e £ ™ > x] 

< E[W n e- £n ] + F[U n e £n > x}. (19) 
Next, by using the martingale property E[W n ] = E[Wi] = 1, we derive 

oo oo —ex / i \ 

£ E[W n e-™] = e~ £n < 7^— =ol-g) as oo. (20) 



n>x n>x 



Then, recalling conditions 1) and 2) of Theorem [3] (or Theorem [T]), we can choose 5, e > 
small enough and no large enough such that ^(a* — 5) + 2e(a* — 5) = — £ < and 



16 



n 1 log E 



J-J-Jl 



< ^(a* — (5) + e(a* — 5) for n > no, which implies, for x > uq, 

g£(a*— S)n 



iP[n„e eri > x] < — — 



(a* -5) 



a*— 5 



X 



-Cx 



< 



1 



O ( — I as x — > oo. 



21) 
□ 



(1 - e-i)x a *- 5 

Finally, by using (fT9j) . ([20]) and (|2T|) . we complete the proof. 

The following lemma relates A n to the corresponding multiplicative process. 

Lemma 5. Let e > and A l n be the reflected branching process, as defined in (p||), then, for 
x > I, 



A l n >x 



< 



max n,(l + eY > x/l 

1<J<" 



+ nl 



B 



Is 



where IT. = H^-j and Blf = Uj>i{ Y?i=i B n( J n) > j>(J n )(l + e) } for any integer 

Proof. From ([6]), we have 



n . 



A^ = max( Z l _ n ,Z^ (n _ iy ... .Z^,^ 



(22) 



Next, let Z l _ n (k) be the branching process that starts at time — n with I objects and is observed 
at time k > -n. Note that Zi^-i) = I, Zi-(0) = Z l _ { and 



z -j= E 5 -i( J - 



i=l 



for j > 1. Now, by using the preceding observation, (i22j) and Z l = I, we derive, for x > I, 



At > x 



< 



max ( Z l _ n , Z l _ {n _ iy ■ ■ , ZL 1} I ) > x, (B^f 



+ . 



B 



■Le 



< 



max ZL n (-l){l + eMJ-i),--- , #_ 2 (-l)(l + e)M J_ x ), 1(1 + e)fi( J_ x ) > x, (B l ±\ 



2 l,£ \C 



+ . 



B l l\ 



< 



(1 + eHJ-i) max (z|(-l)) > z |> J {n( J_x)(l + e) > x/Z} 



+ 



B l l\ 



Then, intersecting with event B l f 2 an d using 



Z -A- 1 )= E B -^ J - 



1=1 



for j > 2, one easily obtains 



A: > x 



< 



j(l + £ )V(J-2HJ-i) max (zft-2)' 
U {max(u(J_ 2 )u(J_ 1 )(l + e) 2 , M (J_x)(l + e) ) > x/l} 



'^1 



which, by continuing the induction and using ' 



B 



l,s 



B 



for all i, finishes the proof. □ 
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Now, we show that the "error" event Bq £ in the preceding lemma has a negligible probability 
for large I relative to any power law distribution. 

Lemma 6. If sup,- E [e^wO-MCDI] < oo, 6 > and fi = inf j > 0, then, by setting 
lx = , < 5 < 1 in the definition of B 1 q ,£ in Lemma\f^ we obtain, for any (3 > 0, 



B, 



o 



1 



as x — > oo. 



Proof. First, we derive 



P(n) = P 



£flj(Jo)>M(Jb)(l + e: 



??■ 



i=l 



< 



M W - mW) > e/m 



i=i 



C>o, 



which, by using the elementary inequality e x < 1 + x + x 2 e' a ' /2, x E R and setting x 
B(J)-fi(J), yields 



Pint < | 1 + i-E 



- M j)) Vi B ( J )-^ J )i 



For any 77 > and large enough n such that £ = rj log n / (eym) < 9, the assumption 
supj-E [ e 9 l B 0')-/^(i)l] < 00 implies 



C = E 



(S(J)- M (J))-e 



2 _C|B(J)-/i(J)| 



< OO, 



which yields 



P(n) < 1 + 



C(r] log n) 



2\ n 



n" 7 ? = O — 
n 7 ? 



(23) 



Therefore, choosing 77 = 1 + (3/6 in ([23]) . we obtain, for / x . = [a^J , < 5 < 1 and /3 > 0, as 

x — ► 00, 



00 / 00 1 \ 



o 



1 

rP ) ' 



□ 



The following lemma allows us to increase the lower barrier in order to prove the upper 
bound. 

Lemma 7. Assume that A 1 ^ and are defined on the same sequence {Bn(J n )} with initial 
conditions l\ and 1%, respectively. If h > h, then, for all n > 0, 



A h > A h . 

n — n 
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Proof. The result holds trivially for n = 0. Now we prove the result using induction. Suppose 
that it is true for all < k < n, and for k = n + 1, 



A£ + i=max J2 B n( J n), h > max £>;(J n ), i 2 = A|? +1 , 



i=l 



i=l 



which implies that the lemma is true for all n > 0. 

Now, we are ready to complete the proof of the upper bound. 



□ 



Proof of the upper bound of Theorem^ Choosing l x = [x £ \ > 1,0 < e < 1, using Lemma [7] 
and then Lemma [5j we derive 



A > x 



sup Z_a > x 



< P A , > x 



< 



< 



A£j >x| + 



["L*J 



sup • > x 



J>2 



supllj(l + e)- J > x 



l-E 



> x 



+ xl 



tf,'" -|- 



Zj>x 



^/i(x)+/ 2 (x) + / 3 (x). (24) 

Now, define a new process {/i £ (J n ) = /x(J n )(l + e)}„>i and LT^ = n^-n ^(Ji)- Then, for 
e small enough, we have 

1) logE(n^)° -> fy e (a) = *(a) + alog(l + e) as n -> oo for | a - a* |< e*, 

2) ^ e is finite in a neighborhood of a*, a* < a*, and differentiable at a* with ^(ct*) + 
a* log(l + e) = 0, tf'(aj) > 0, and 

3) E [(II^) *] < oo for n > 1. 
Therefore, by Theorem [H we obtain 

logP[su Pi>1 11* (1 + ef > x 1 - 6 } 



lim 

x— >oo 



logx 



-(l-e)a*, 



which, in conjunction with Lemma [Hand Lemma [6l yields 

h{x) + h(x) = o(h{x)). 

Then, combining (|24j) . (|25|) and (|26|) yields 

logP[A* >x] ^ log((l + o(l))/i(x)) # 

: < : > — (1 — £)a £ as X — > oo. 

log x log X 

Since *$> £ (a) is continuous in a neighborhood of a* in both a and e, we derive 



(25) 



(26) 



lim a* = a* 



implying, 



— logP[A>x] „ 
hm - 1 < —a 

x'^oo log X 



(27) 
□ 
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6.1.2 Proof of Theorem [3} Lower Bound 

In order to prove the lower bound, we need to establish the following three lemmas. Specifically, 
Corollary [1] allows us to obtain a lower bound for A while, maybe somewhat counterintuitively, 
increasing the lower barrier I. 

Lemma 8. Let {A^ 1 } and {A^ 2 } be defined on the same modulating sequence {J n }n>o o^nd 
independent random variables y^Bn 1 (j) , Bp? (j)"^ with Bn k (j) identically distributed for fixed j . 
Then, 

A£+i«<A£+AW 
where An 1 and An 2 are conditionally independent given {J n }n>o- 
Proof. We use induction to prove this lemma. Starting with n = 1, we obtain 

(yi+V2 \ / yi V2 \ 

B l (J ), yx+y 2 ) = max £ B^(J ) + £ B^(J ), yx + y 2 \ 
i=X / V i=l i=l / 

(Vl \ / 2/2 \ 

^B^iJo), yx j +maxl ^5q 2 (Jo), y 2 I 

= Af +Af , 
since for any x u x 2 ,y u y 2 , 

max( xx + x 2 , yx + y 2 ) < max( xx , yx ) + max( x 2 ,y 2 ). 
The proof is completed by induction in n, 



A 2/1+3/2 



A y ^ 2 = max ^ B{(J n ), Vl + y 2 j < max ^ ^ B*(J n ), yi + y 2 J 

<A^ +1 + A^ +1 . 

□ 

Next, a straightforward application of the preceding lemma yields the following corollary. 
Corollary 1. If {A* Ax<j<y ore conditionally i.i.d copies of A^ given {Ji}i<i< n , then, 

d v , 
i=i 

Now, we basically establish that the supremum of IL, occurs most likely for small indexes 
i < hlogx. 

Lemma 9. Assume that condition 1) of Theorem^ is satisfied, then, for < e < 1 and any 
(3 > 0, there exists h > such that, when x — ► oo, 



sup IIj(l — ef > x 

i>h logx 
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Proof. Using condition 1) of Theorem O we can choose < a < a* with n 1 logE[n"] — > 
fy(a) < and no large enough, such that E [II"] < £ n , < ( < 1, n > uq. Thus, for 
h = -/3/logC > and x > e n °/ h , 



sup Ilj(l - ef > x 

i>h log x 



i>h log X 



i>h log x 



□ 



Finally, the last lemma shows that Yjl=i ^n(^n) can n °t deviate too much from jfJ.(J n ) for 
large j. 



Lemma 10. For < 5, e < 1 and df = Uj>z{ J2l=i Bn(J n ) < i"(^n)(l — e) }, we obtain, for 
any j3 > 0, 



Proof. The proof of this lemma is basically the same as Lemma El Observe 



P(n) 



< 



< 



Y J B'UJo)<v(Jo)(l-e) 
i=i 

n 

i=i 

n 

(/^( J o) - B o( J o)) > £ t± n 



.1=1 



Then, by using a similar argument as in deriving (|23p . we can prove, for any (3 > 



,lx s \,e 



□ 



Next, we can complete the proof of the lower bound of Theorem El 



Proof of the lower bound of Theorem^- First, using Corollary HJ we obtain, for any integer 



[A l n >x]> P[A£ > x] 



yF[Al > x] > P[Ei=i K,j > yx) ^ n^l > yx] 



> 



(28) 



y y y 

Now, using ([6]) , similarly as in the proof of Lemma O for < e < 1 and C\f defined in 
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Lemma fTUl we derive 



P[A£ > yx] > 



c 



0™ ( Z -^ >yX '\ U C i' 



> 



> 



> 



sup - e) 1 > x, 

Ki<n 



sup IL(1 - ef > x 

Ki<n 



sup IT (1 — e) 1 > x 

i>l 



c 



supllj(l - ef > x 



??P [C, 



h(x) - h{x) - h{x)- 



(29) 



note that {7j(x)}i<j<3 here are different from those in ([21 

Next, similarly as in the proof of the upper bound, define a new process {fi e (J n ) = n(J n )(l— 
e)}n>i and let 11^ = n^=-n ^e{Ji)- Then, for e small enough, we have 

1) nr 1 logE(n^) a -> V £ (a) = *(a) + alog(l - e) as n -> oo for | a - a* \< e*, 

2) ^ £ (a) is finite in a neighborhood of a*, a* > a* and differentiable at a* with ^(a*) + 
a* log(l - e) = 0, *'(«*) > 0, and 

3) E [(II* < oo for n > 1. 
Therefore, by Theorem [H we obtain 

logPfsup^n^i-^^x] 



lim 



logx 



(30) 



Now, by setting y = [a^O < 5 < 1, n = [x\ in ([28]) . ([29]) . and using Lemmas l9l and [TU1 it is 
easy to see that 

h{x) + h{x) = o(h{x)), 



which, by ([28]) and ([29]), yields 

logP[A > x] > logPA^ > x] 

> log(Ji(») - h{x) - h{x)) - 5 log x 
= log((l — o(l))Ix(x)) — Slogx. 

From the preceding inequality and (|30p . we obtain 

.. logP[A>x] , 
hm > —a* — o. 

x^oo log X 



(31) 



Since *$> £ (a) is continuous in a neighborhood of a* in both a and e, we have lim e ^o a * = a * ■ 
Then, passing e, 5 — > in (|3ip completes the proof of the lower bound, which, in conjunction 
with (|27p . finishes the proof of Theorem [3j □ 
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6.1.3 Proof of Theorem U 

Proof. Using the same arguments as in deriving (|24p in the proof of the upper bound of 
Theorem [3l we obtain, for l x = [x\ > I and < e < 1, 



[A > x] < P A^j > x] + 



sup > x 

j>x 



< 



< 



> X 



sup IL,(1 > 1 



+ xP 



oo 



/i(x) + I 2 (x) + I 3 (x). 



(32) 



Recalling ILy = 11?=- 1 an d noting sup^- fx(j) < 1, we can choose e > such that 

supj < 1, which implies Ii(x) = 0. And, using Lemma[6j we obtain h(x) = O (x _/3 ) 

for all > 0. 

Next, using similar arguments as in deriving f)19f) in the proof of Lemma HI we obtain, for 
e > and j > 1, 



Zj>x 



< e [w je - £j ] + p [iL;e £j > x] , 



which, by recalling sup.,- fx{j) < 1 and choosing e small enough such that PfiL/e^ > x] = for 
x > 1, yields, 

oo oo 

h{x) < E^e^i) = ^ = ° i e ' £X ) ■ 

j>[x\ j>\x\ 

Finally, combining (|32p and the bounds on Ii(x), l2(x) and Is{x) finishes the proof. □ 

6.2 Proofs of Theorems [7] and M 
6.2.1 Proof of Theorem [7J 

In order to prove Theorem we first derive the following lemma. 

Lemma 11. Under the assumptions of Theorem^ there exists 7 > 0, such that 

A a *+~f' 

(JJ*(J) - M (J)) 

i=l 



E 



< 00. 



Proof. We observe that, for x > 0, 



£ (B*(J) - ai(J)) 







> X 


= p 



.1=1 



+ 



M (J) - £ J)) > 



x 



i=l 



h + h- 



We choose 7 and 5 such that < 7 < a* and 7 < 5 < a*. To evaluate Ii, for < e < 
(a* - 5)/2, we set < (3 = (5 + e)/(a* - e) < 1, and obtain 



It < 



A > x 1+ ^ 



+ 



i=i 



(33) 
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which, by recalling that Theorem [3] implies P[A > x] = O (x e -*), results in 



A > x 1+/3 ] = O {x^ a * 



+&) 



(34) 



Now, we study the second probability on the right-hand side of f)35[) . Using the fact that J is 
independent of A and applying Chernoff bound, we obtain for £ > 0, 



i=i 



i=l 



= P[A = n]P 

n=l 

< ^ P[A = nje'^ (E 

n=l 



Y,{B\J)-h{J))>x 



(35) 



Then, setting t = ( {B(J) - /i( J)) in ([35]), using e* < 1 + i + t 2 e |t| /2, t G M and observing that 
E[B(J) — fJ.(J)] = 0, (j35j) is further upper bounded by 



n=l 



c 2 



P[A = n] (1 + 2-E (B(J) - ,u( J)) 2 e^ J )-^ J )l 



-(x 



Next, supj-E [ e o|-BO")-/*Cj)l] < oo implies C = E \(B( J) - /x( J)) 2 e C|B(J')-M-/)l 
Hence, for x large, we have £ = (a* + <5) logx/x < 9, implying that (f35j) is bounded by 



< oo, C < 0. 



n=l 



2x 2 



L ^V[A = n]( 1 + C « a, t? l0gl)2 V x 



= q /._(«»+*)\ 



since /3 < 1. Combining (|34|) . (|35j) and ([36]) proves 

/i = O . 
By using the same approach as in proving (|37p . we can also show 

I 2 = (x~( a * +s f 

implying 



(36) 



(37) 



i=l 



> x 



Therefore, since 5 > 7, 

A 



E 



£ {B i {J) - M ( J)) 



8=1 



o*+7" 






roo 
= / P 






JO 





£ J) - /i( J)) 



8=1 



a* +7 



> X 



dx 



= O 

which finishes the proof of the lemma. 

Now, we proceed with proving Theorem [71 



a* + 6 



x a *+~tdx < 00, 



□ 
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Proof of Theorem^ The proof is based on Corollary 2.4 in [32], for which it is sufficient to 
show 



I = E 



max ( E B ^ J )' l Y) 



< oo. 



(38) 



In order to prove the preceding inequality, we will use the following elementary inequality 
(see equation (9.27) in [32]), for x,y > 0, 



\x-y\ , 



< a < 1 



a\x — y\ (x a 1 + y a x ) , 1 < a < oo. 



|z -in < 

First, we prove the case when < a* < 1. Using the fact that 



max ( E J )' 1 ) ) = p * 1 (e b< ( j ) - z ) + J) ) 



we obtain, by using (f39l) and recalling Lemma fTTT 



7 < 21° + IE 



< 2Z a + E 



£ (s*(J) - n{J)) 



8=1 



< oo. 



Next, we prove the case when a* > 1. Applying (|39j) and (l40j) in (j38j) . we obtain 

A \ Q * 



I < 2l a +E 



< 2l a + a*E 



E^( J ) 



i=l 
A 



+ a*E 



E(^(j)-mj)) 

A 



(/,(J)A) Q 

A 

E^( J ) 

i=l 

iA M (j)r*-' 



a*-l' 



i=l 



2Z a +7x+7 2 . 

For 7i, we use Holder's inequality to obtain, for < e < 1/2, 



7i < a*E 



< a*E 







a 

1-e 


a* 


E (^( J ) 

i=l 


-M«/)) 




E 


E (^( J ) 




a 

1-e 


1-e 

E 


2=1 









E^( J ) 



(a* — l) a* 
a*+e-l 



vi=l 



(ck* — 1 Jck* 

A 



(39) 



(40) 



(41) 



(42) 



(43) 
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where the last inequality uses the fact that 

A 



Now, Theorem [3] implies that 



E 



i=l 



(a* — 1 )a* 
A a*+e-l 



< oo, 



which, in combination with Lemma QT] and (|43p . results in 

ii < oo. 



(44) 



Using the same argument as in proving (|43p . we obtain, by noting that A and fJ,(J) are 
independent from each other, 



h < a*E 



i=l 



E 



a*+£-l 



E 



(ct*-l)a* 

/x(J) 



a*+e-l 



< OO, 



which, in conjunction with (I44p . proves (138p and finishes the proof of Theorem [3 



6.2.2 Proof of Theorem I 



□ 



The proof of this theorem relies on the following lemmas; the first one is based on Theorem 3.7.1 
of 



Lemma 12. {X(j), Xi(j)}ij£% are zero mean independent random variables that are iden- 
tically distributed for fixed j. Fix a sequence a n — > such that na n — >• oo as n — ► oo. // 
supj E [e^C?)] < oo for 8 > 0, then, there exist no, h > 0, such that for all n > n$ and any 
random variable J £ Z, 

n j — l 
P Vl,(J)>, - <e"£. 

f"f V a n 

Proof. For < /? < 9, define <pj(w) = E [e^^ | j] and use Taylor expansion to derive 
<pj(u>) = <pj(0) + <p'j(0)u + ^p-u; 2 , 0<(<oj<(3. 



< supE 

3 



X(j) 2 e™ 
<Pj(u) < 1 + Kpu 2 , 



K/3 < oo, 



Noting that cpj(0) = 1, ^(0) = and 

^(C)=E[x(J) 2 e^( J ) | J 

we obtain, for < uj < (3, 
which implies, 

< e^v^E [(tpj(u)) n ] < e'^V^ (1 + Kpuj 2 ) n < e~^^e nK ^ 



n j 

i=l ' 
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Since there exists no such that f3 > 1/ (2Kp^na n ) for all n > no, we can choose uj 
l/(2Kj3y/na n ), which implies, for n > no, 



> 



i=l 



< e iK P an = e ~, 



where h = l/(4Kp) > 0. 

Lemma 13. For any I £ N, define 



□ 



fc>; I i=i J 

and 

< = U { E J «) < M J «) ( x " M-'r" 4 ) } • 

k>l { 1=1 ' J 

If I > (logx) 3+7 , 7 > 0, then, under the conditions of Theorem^ we obtain, for any (3 > 0, 



Proof. Defining a n = n x / 3 and observing that na n is monotonically increasing in n, we obtain 

' RirXl > ku(.T„) ( 1 4- 

M V lai 



oo 

fc=« 

oo 

k=l 

oo 



£b;(j„) >M^)(i + ^/ji: 

i=l 



J4(j B )>MJ») (i + 



i=l 

A; 



1 / 1 



A* V ^«fe 



E(w-^))> t - 

i=i V fl fe 



which, by applying Lemma [T2| yields 



<Ee~-*< e 



k=l 



k>(logx) 3 +~< 



hk 1 / 3 ^ I 1 i 
r = O I — | as x ^ oo. 



By the same argument, 



oo 

^]<E ] 

fc=/ 

oo 

fc=z 



E4(4)< M4) l 



i=l 



1 / 1 



EW^)- fli nW)>J- 
1=1 1 



as x — > oo. 



□ 
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Following the proof of Lemma H] with minor modifications, we can prove the following 
stronger result. 

Lemma 14. For any f3 > 0, there exists h > such that the branching process defined in fTP 
satisfies 



n>h log x 



Z l n >X 

Now, we proceed with the proof of Theorem 



O ( — g I as £ — > oo. 



Proof (of Theorem^): First, we establish the upper bound. Setting e = [i 1 l x / 3 in Lemma 
[5j we obtain 



Ai > lx 



< 



max Hj (1 + 1 l 3 ] > x 



i<i<" 









^ > X 


+ nP 





where &q is defined in Lemma [T3l For / > (logx) 3+7 , we obtain 



A' > lx 



sup Z-j > lx 



< 



A; > lx 



+ 



supZ_j > lx 

j>n 



< 



sup IF,- ( 1 + fi I a ) > x 

l<j<n 



+ nP 



j>n 



which, by setting n = \h\ogx\ with h being chosen as in Lemma [T4"l and applying Lemmas 1131 
[Til yields, 



A 1 > lx 



< 



< 



sup ILj (l + fi 1 l $\ > x 

l<j'</iloga; ^ ' 
SUpIL > X [ H --: - ,„ ] 



+ 
-ft log x 



1 



+ o 



f.(X* 



Finally, by using Theorem [5] and observing that lim^oo ( 1 + M ( log ^1+7/3 



-h log x 



1, we 



obtain 



lim 

( > (logi) 3 + ^ 
X — > 00 



A 1 /I > x 



x a < 



1 - IIG?-, 



a* xe a * x G+{da 



Next, we prove the lower bound. Recall that TT n = YIj=i MG/i) an d H = T\jl-i ^(Jj)- 
Then, for I > (logx) 3+7 and n = [hlogx\ where h is chosen as in Lemma [Til we have 



A n > lx 



> 



sup rrjj ( 1 — /i *z 

0<i<n-l V ~~ 



Ki<n 



> 



.-ll-T 













> X 




-P 










) > X 


— n' 


P 


4 



/pi 



'n-l 



sup IT ( 1 — \l I 3 

i>l 



\ h log x 






J > X 


-P 


sup Hi 






_i>n 









) > X 


- nP 





h-h- h, 



(45) 
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where S'q is defined in Lemma [T3l By Lemma we obtain, 



h. < 



and by Lemma [T3l 



sup Hi > x 

i>h log x 



h = o 



Thus, combining (f4"5j) . (f^6|) and ([37]). we obtain 



Al > lx 



> 



h log x 



??? n H 1_ M(Iogx)^/3 



> X 



which, by using the same argument as in the proof of the upper bound, yields 



lim 

l > (logx) 3 + ~< 
X — * oo 



A 1 /I > x 



x a > 



1 - IIG, 



a* J °° xe a * x G + {dx)' 



(46) 



(47) 



□ 



6.3 Proofs of Theorems QUI HI and fl2l 

Proof of Theorem\l(A First, we prove the upper bound. For a fixed a that is in the neighbor- 
hood of a* and < e < A, there exists n £ such that E [(11°)"] < e (*(°0+O" and e^ A ~ £ ) n > 
P[iV > re] > e -( A + E ) n for all n > n £ . Since ^(a*) = A and ^'(a*) > 0, we can choose 5, e > 
small enough such that \&(a* — <5) — A + 2e = — ^ < 0. Thus, noting that N is independent of 
n n , we obtain 



[14 > x] = F i N = n l P [ n n > X ] 
n=l 

n e oo 

< J2 F i N = n l P [ U n >x]+ ^ P[N > n]P [n° > x] 



n=l 
n=l 

1 



E 



< O 



x'- 



n 



+ 



j oo 



n=n E 
oo 



-(A-e) 



\a*-<5l 



X' 



a* —8 



n=n £ 



which implies 



N 



T~. lOg I 

nm 

x^oo log X 



> X 



-a* + 5. 



Passing 5 — > in the preceding equality completes the proof of the upper bound. 

Next, we prove the lower bound by using the standard exponential change of measure 
argument. For < 3e < A, S > 2e/(A — 3s) and log re > n £ , recalling that e -( A - £ ) n > p[jV > 
n] > e~( x+£ ^ n , we obtain, for large x, 



(l + 5)logx <N< (1 + 25) logs' 



*'(a*) 



H 



(A-e)(l+2<5) logx 



> e 

> (l-e)e 



*'(<**) _ g *'(a*) 

(A+e)(l+<5)log:r 



*'(<**) 
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since (A + e)(l + 5) < (A — e)(l + 25), and this implies that there exists 5 < £ < 25 such that 
n x = f(l + C)(logx)/*'(a*)l satisfies 



F[JV = n x ] > 



(1 _ e )^( a *) e -(A+e)(l+<5)logx/tf'(a*) 



5logx 

Therefore, using (|4"8~|) and denoting log Jj by Xj, we obtain 



(48) 



F[U° N > x] > F[N = n x ] 



^ log Ji > log 



X 



i=l 



> 



(1 _ e )$ / ( a *)e-( A + e )( 1 +' 5 ) l°g*/*'(a*) 



5logx 



> 



,i=i 



^'(a*) 



■n 3 



(49) 



Next, we perform an exponential change of measure for the probability on the right-hand 
side of (|49p . Let P* be the probability measure on M. n defined by the probability measure P of 
the stationary and ergodic process {Xi}i>i 

¥* n (dxi,--- ,dx n ) = e a * s "-*"( a *)p(dxi, • ■ ■ ,dx n ), 

where S n = Yl?=i and ^ri(a) = logE[e a,Sn ] satisfying n~ 1 ^ n (a) — > \I/(a) in the neighbor- 
hood of a*. Thus, 



> 



i=l 



gyp. 

T+5 ' 



■n 



E* 



> E! 



> e" 



e _ a . 5 „+*„K)i( 5n> ^M n 



e -a*5„+*n(a*) j 

: (l + 2i5)'g / (a*) 



^ - *'(«*) 
n 



< 



1 + 5 



1+3 



n+* n (a*)p* 



Then, by Claim 1 on page 17 of |14j . we know that 



'S'n 



11 



< 



i + 5 



n 



1 as x — > oo, 



< 



f'(a*)5 
1 + 5 



(50) 



which, using (|49|) and setting n = n x in ([50]) . yields 



lim 

x— >oo 



logP [IT 



iV 



> x\ 



logx 



> 



(A + £)(! + 6) a*(l + 25) 2 (l + 5)*(a*) 



*'(Q!*) 



1 + 5 



+ 



Finally, by passing s, 5 — > in the preceding equality and noting = A, we prove the 

lower bound. □ 

Proof of Theorem We give a constructive proof based on the connection (duality) between 
the M/GI/1 queue and the geometrically stopped multiplicative process. 

Consider a M/GI/1 queue with the service distribution F[S >t] = G(t),t > and Poisson 
arrivals of rate A = p/E [S] ,E[5] < oo. Then, by the Pollaczeck-Khinchine formula (see, e.g., 
Theorem 5.7 on p. 237 of [5]), the stationary workload Q of this M/GI/1 queue is equal in 
distribution to J2iLi Hi, where N, {Hi}i>i are independent with F[N > n] = p n ,n > and 

( x F\S > s]ds ( x G(s)ds 
F[Hi <x] = ^ — J = J- \ = P[log Ji<x], x>0, 



MS] 



J QO G(s)ds 
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where the last equality follows from the assumption. Now, using the preceding observation we 
show that there exists a RMP such that M = satisfies 



F[M > x] = F[Q > logx] 



N 



^2Hi> log x 



i=l 



N 



i=l 



F[U° N >x], (51) 



which proves the first claim of the theorem. 

Next, using the additional assumptions of the theorem and applying Cramer-Lundberg 
theory for the M/GI/1 queue (e.g., see Theorem 5.2 in Chapter XIII of [5]), we obtain 



lim F[M > x]x a * 



{l-p)^G{y)dy _ 

°*p Jo* ' y ea * yG {y) d v'' 



which, by (|51j) . completes the proof. 



□ 



Proof of Theorem The second equality is implied by Theorem \TU[ and we only need to 
prove the first one. We begin with proving the upper bound. Recalling the definition of B l r f in 
Lemma[5]and, for n > 1, < e, £ < 1, choosing x^ > z > Zq, we obtain 



P [Z%° > x] < F Zl x ^ > x\ 



< 



< 



n-l 



i=0 

11° (1 + e) n > x 1 ^ 



C 



+ 



n-l 

U 8 

.i=0 



Lx€j, £ 



+ raP 



which, by the independence of N and {B^(j), J n }, implies 

F[Z N > x] < F \u° N (l + e) N > x 1 ^} + E[N]F 



B, 



(52) 



Next, define a new process {IT^ = II°(1 + e) n }. It is easy to see that, for e small enough, 
the sequence {11^} satisfies n _1 logE [(IT^ ) a ] — > \£(a) + alog(l + e). Therefore, by Theorem 
TOj we obtain 

logP [11^(1 + e) iV > x 1 ^] 



lim 

x— >oo 



log X 



(53) 



where a* satisfies $(a*) + a* log(l + e) = 0. Combining 

— logF[Z N >x] 



and Lemma El we obtain 



lim 

x— >oo 



log X 



<-(i-£K 



which, by passing e, £ — ► 0, completes the proof of the upper bound. 

Now, we prove the lower bound. Let {Z^A be i.i.d. copies of {Z^} given the common 

modulating process { J n }. Then, noting that Z^ = Y^j=i %\ • for integer y and using the union 
bound, we derive, for < £ < 1, n > 0, 



F[Z n > x] > 



L^J 



^>x]>^ 



Hence, recalling the definition of Cn £ in Lemma [T0| we obtain 

71-1 



[£» > Xl > — 



X 



i=0 



> ^(P [n0(l-er>x] -nP 
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which, by the independence of N and {B % n {j), J n }, yields 

1 



Z N > x] > — (P [U%(1 - £) N >x\- E[N}F 



Then, by using the same approach as in the proof of the upper bound and Lemma \TU[ we can 
easily show that 



r iognz N >x] , 

lim > —a . 

x _oo log x 

Finally, by combining the upper bound and the lower bound, we finish the proof. 



6.4 Proof of Theorem 



□ 



Proof. We begin with the upper bound. Notice that when the system reaches stationarity, N n 
follows the Poisson distribution, and therefore, there exists H > such that 

F[N > [Hlogx\] =o(j~) . (54) 

Denoting by {Aj}j>i the i.i.d. copies of the random variable A defined in Lemma [21 we obtain 

F[Z S > x}< 



N 

£ 

.4 = 1 



A,- > x 



< 



[Hlogx] 

Yj A i > X 

i=l 



< H log x } 



A > 



+ F[N > [Hlogx\ 



Hlogx 

which, in conjunction with Theorem [3] and equation (|54p . yields 

— logP[Z s > x] , 
hm < —a . 

X^rOO log X 



(55) 



Next, we proceed with the lower bound. Construct a new process that has the same arrivals 
{A n } as described before but only allows at most one object to exist in the system. The 
construction goes as follows: all the new arrivals will be dropped if there is an object present 
in the system; similarly, when newly generated objects arrive to the empty system, only one 
object will be accepted while others will be dropped; the object, if any, evolves according to 
an i.i.d. copy of the modulated branching process Zp. Denote the total size of the object in 
the new system at time n by Z_ n , and observe that Z_ n forms a renewal process. Then, taking 
out all the empty (idle) periods of the new system and concatenating the remaining periods 
sequentially yields a process equal in distribution to a reflected modulated branching process 
{A n }, as defined in ([2]). Therefore, when the new system is in stationarity, we obtain, by the 
independence of {A n } and Zp, 

F[Z S > x}> F[Z Q > x]= P[Z > 0]P[A > x], 

which, by Theorem [3l yields 



r logP[Z B >x] „ 
hm > —a . 

x ->oo log X 

Finally, combining (|55p and (|56p finishes the proof. 



(56) 
□ 
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